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ERROR DIFFUSION HALFTONING WITH BANDPASS NOISE 

SHAPING 

BACKGROUND 

[0001] Halftoning is performed to render continuous tone digital grayscale 
and color images into p atterns o f p ixels t hat c an b e d isplayed o n b i-level d evices 
such as printers. The rendered images are commonly referred to as halftone images. 
The pixels are arranged in patterns such that a halftone image creates the illusion of 
continuous tones. 

[0002] The halftone images may contain halftone patterns composed of 
isolated pixels. However, isolated pixels are not reliably reproduced by laser printers 
and other electro-photographic devices. 

[0003] The halftone images may contain clusters of pixels. The pattern 
power spectra of the clustered pixels exhibits a strong mid-frequency component, as 
opposed to the strong high frequency component exhibited by the isolated pixel 
halftone patterns. Clustered pixels can be reliably reproduced by laser printers. 

[0004] Error diffusion halftoning is a high quality method of rendering 
continuous tone images. The high quality is achieved by non-linear feedback. 
Quantization e rrors a re filtered u sing ana rror filter, a nd t he filtered e rrors a re fed 
back to the input in order to shape the quantization noise into high frequency regions, 
which are less perceptible to the human visual system. As a result, the error diffusion 
halftoning can produce dot patterns that are visually pleasing. 

[0005] It can be advantageous to use the error diffusion halftoning to 
produce clustered pixel halftone patterns. Such halftoning can produce patterns that 
are robust to printer distortions due to the poor isolated pixel reproduction by laser 
printers and other electro-photographic devices. 
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SUMMARY 

[0006] According to one aspect of the present invention, error diffusion 
halftoning includes using a quantizer having an input and an output; and using a 
system having a bandpass characteristic to modify the quantizer input without 
feeding the quantizer output directly into the quantizer input. The error diffusion 
halftoning can produce clustered pixel halftone patterns that can be reliably 
reproduced by laser printers and other electro-photographic devices. 

[0007] Other aspects and advantages of the present invention will become 
apparent from the following detailed description, taken in conjunction with the 
accompanying drawings, illustrating by way of example the principles of the present 
invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0008] Figure 1a is an illustration of an error diffusion halftoning system 
according to an embodiment of the present invention. 

[0009] Figures 1b and 1c are models of the system of Figure la. 

[0010] Figure 2 is an illustration of an error diffusion halftoning system 
according to an embodiment of the present invention. 

[0011] Figure 3 is an illustration of an error diffusion halftoning system 
according to an embodiment of the present invention. 

[0012] Figure 4 is an illustration of an apparatus for performing error 
diffusion halftoning according to an embodiment of the present invention. 

[0013] Figures 5a-5c are illustrations of noise transfer functions in 
accordance with an embodiment of the present invention. 

[0014] Figure 6 is an illustration of a bandpass transfer function in 
accordance with an embodiment of the present invention. 

DETAILED DESCRIPTION 
[0015] The present invention is embodied in a method of performing 
clustered pixel error diffusion halftoning on a continuous tone (contone) image. The 
contone image is represented by a plurality of pixel values. Each pixel value contains 



-2- 



PDNO 200205808-1 



n-bits, where n>1. If n=8. for example, the pixel has 256 possible values. The error 
diffusion halftoning transforms the contone image to a halftone image. Each pixel 
value of the halftone image contains a single bit (e.g., 1 = a pixel; 0 = no pixel). The 
halftone image contains patterns of these 1-bit pixel values, which create the illusion 
of a full range of tones. 

[0016] Reference is made to Figure 1a, which illustrates a clustered pixel 
error diffusion halftoning system 100. The system 100 receives a raw input signal 
represented by x(m), where m is a 2-D vector of pixel coordinates (ml, m2), and x(m) 
represents a grayscale value of pixel of a contone image at coordinates ml , m2. The 
pixels of the contone image may be provided serially, by scanning the contone image 
in a serpentine order. Each pixel in the contone image may be processed as follows. 

[0017] The raw input signal x(m) is modified by a filtered error signal e'(m). 
The modified input signal u(m) is supplied to a quantizer 110. The quantizer 110 
outputs either a 1 or a 0, depending on whether the modified signal u(m) is greater 
than a threshold. For example, 



where o(m) represents the output signal of the quantizer 110, and T represent the 
threshold. 

[0018] The filtered error signal e'(m) is produced by one or more filters 112, 
which collectively have an effective bandpass transfer function. The filtered error 
signal e'(m) modifies the quantizer input at 1 14. 

[0019] Figure lb illustrates a model 120 of the system 100 (Figure lb does 
not illustrate an embodiment of the present invention). Assume no input image is 
present, and the quantizer 110 is replaced by a source 122 of uncorrelated noise 
n(m). The noise source 122 injects the uncorrelated noise n(m) into the model 120. 
The model 120 of Figure 1b is linear. 

[0020] Additional reference is made to Figure 1c, which illustrates the 
response of the model 120. A transfer function 130 between the quanfizer output 
and the noise injection (freq response of output / freq. response of noise injection) 




u(m) > T 
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has a bandpass characteristic. The bandpass characteristic causes the noise n(m) to 
shift from high frequency to a mid-range frequency to promote pixel clustering. 
[0021] The following noise transfer function may be used. 

l-BU)^ 

l-aH{z)-\-aH{z)K(z) 

where H(z) and K(z) are transfer functions that contribute to an "effective" bandpass 
transfer function, and a is a scalar. The transfer functions H(z) and K(z) may be, for 
example, low pass transfer functions that contribute to the effective bandpass 
transfer function. 

[0022] B(z) is the bandpass transfer function, which is characterized by a 
mid frequency peak in its magnitude response, surrounded by regions of relatively 
low magnitude response. T he bandpass transfer function may have the following 
form: 

^ {\-a)H{z)-^aH{z)K{z) 
l-aH{z) + aH(z)Kiz) 

[0023] Consider an example in which Floyd-Steinberg weights are used for 
the transfer function H(z), and two equal weights of 0.5 are used in the vertical and 
horizontal directions for the transfer function K(z). The transfer functions H(z) and 
K(z) become 

* ' 16 16 16 16 ^ 

where subscripts h an v denote the horizontal and vertical directions. 

[0024] In the example above, the transfer function K(z) does not favor one 
direction over the other. Generally, it is preferable for the transfer function K(z) to not 
favor one direction over the other. H owever, the transfer function K(z) is not so 
limited. The human visual system is directional. Classic filters such as the four 
coefficient Floyd-Steinberg filter could be used as well. The optimal filters may be 
generated by minimizing a human visual system cost function. 

[0025] The noise shaping behavior of the system 100 can be made mean- 
preserving by having the coefficients of the transfer functions H(z) and K(z) sum to 
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unity at dc. The clustered pixels can be moved closer together or spaced farther 
apart to maintain an average color and thereby avoid tone shifts. 

[0026] The scalar a is a tunable parameter that can be varied to adjust the 
coarseness of the pixel clustering. Increasing the amount of noise in the bandpass 
region increases the amount of pixel clustering. The scalar a may have a value 0 < a 
< 1 . The mid-frequency of the noise is increased as the scalar a increases. When a 
= 0, pixel clustering does not occur, whereby isolated pixels can appear in the output 
image. When a = 1 , the maximum amount of pixel clustering occurs in the output 
image. When a = 0.5, mid-frequency noise is boosted, and low frequency noise is 
attenuated. 

[0027] An exemplary noise transfer function is illustrated in Figures 5a-5c. 
Figure 5a illustrates the transfer function for a=0, Figure 5b illustrates the transfer 
function for a=0.5, and Figure 5c illustrates the transfer function for a=1. The mid- 
frequency range increases as the value of a increases. An exemplary bandpass 
transfer function is illustrated in Figure 6. 

[0028] The pixel clustering can be tuned to suit the needs of a variety of 
applications. The scalar a may be adjusted on a pixel-by-pixel basis, on an image- 
by-image basis, periodically, or at other times. See N. Damera-Venkata and B. L. 
Evans, "Adaptive Threshold Modulation for Error Diffusion Halftoning", IEEE 
Transactions on Image Processing, vol. 10, no. 1, pp 104 — 116 (January 2001) as an 
example of how the scalar a may be varied on a per-pixel basis. The scalar may be 
adjusted automatically or by manual input. 

[0029] The error diffusion halftoning system 100 does not feed the 
quantizer output signal directly into the quantizer input. For instance, the system 100 
does not use the quantizer output to bias the quantizer input. As a benefit, the range 
of inputs to the quantizer 1 10 is not increased, and quantizer overloading is avoided 

[0030] The error diffusion halftoning system 100 is simple to implement 
and, due to image adaptivity, it offers higher quality halftoning than can be achieved 
by clustered pixel screens. The clustered pixel halftone patterns are robust to printer 
distortions due to the poor isolated pixel reproduction by laser printers and other 
electro-photographic devices. The pixel clusters do not give a regular ordered 
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pattern, but the pattern is aperiodic and, tlierefore, does not interfere with the picture 
(e.g., IVIoire effects). Finer lines can be reproduced better, and the quantizer noise is 
perceived as film grain. 

[0031] The error diffusion halftoning system 100 can be implemented with 
any filter or a combination of filters that give the system 100 a bandpass 
characteristic. For example, the system 100 can be implemented with a pair of 2D 
non-separable finite impulse response (FIR) filters, or with a single infinite impulse 
response (MR) filter, or with a single bandpass FIR filter instead of a single MR filter. 
Two of these implementations will now be described. 

[0032] Reference is now made to Figure 2, which illustrates an example of 
performing error diffusion halftoning with a pair of 2-D non-separable low-pass FIR 
filters 212 and 216. The output signal o(m) of the quantizer 210 is supplied to the 
first FIR filter 212, which applies the transfer function aK(z). In doing so, the first FIR 
filter 212 multiplies the current and previous quantizer outputs by weights. An output 
of the first FIR filter 212 is summed with the product (1-a)o(m) and the quantizer 
input signal u(m) at 214 to produce the error signal e(m). Thus 
e(m) = u(m) + (1 - a)o{m) + a^k(k)o(m - k) . 

k^O 

[0033] The second FIR filter 216 applies the transfer function H(z) to the 
error signal e(m). In doing so, the second FIR filter 216 multiplies the current and 
previous quantizer outputs by weights. An output of the second FIR filter 216 
provides the modified error signal e'(m), which is added to the quantizer input at 218. 
Thus u{m) = x{m) - ^ h(k)e(m - k) . 

AreC 

[0034] Reference i s n ow m ade t o F igure 3 , w hich 1 llustrates a n example 
performing error diffusion halftoning with a quantizer 310 and a single 2-D non- 
separable MR filter 314. An error signal e(m) is produced at 312 from the quantizer 
input signal u(m) and the quantizer output signal o(m). Thus e(m) = o(m) - u(m). 
The MR filter 314 applies the bandpass transfer function to the error signal e(m). In 
doing so, the MR filter 314 current takes a weighted sum of the current and previous 
errors e(m), and its current and previous outputs e^m). In this example, direct 
filtering of the quantizer output signal o(m) is not performed. 
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[0035] The clustered pixel error diffusion halftoning is not limited to 
grayscale contone images; it can be performed on full color images. For example, a 
24-bit pixel value devotes 8-bits to a red color component, 8 bits to a green color 
component, and 8 bits to a blue color component. Thus each color component has a 
range of 256 values. The halftones could be extended by using a color smooth 
quantizer described in U.S. Patent Publication No. 2003/0038953 published Feb. 27, 
2003. 

[0036] The clustered pixel error diffusion halftoning is not limited to any 
particular h ardware 1 mplementation. A n exemplary i mplementation i s i llustrated i n 
Figure 4. 

[0037] Referring to Figure 4, a machine 410 includes a processor 412 and 
memory 414. The processor 412 can be a digital signal processor (DSP), which 
implements a single MR filter or a pair of FIR filters. The memory 414 stores the 
weights for taps of the filter(s) and a program 416 for instructing the processor 412 to 
perform the error diffusion halftoning described above. The input signal can be 
supplied by an external source. In the alternative, the processor 412 can be a 
general purpose processor that is programmed to perform the error diffusion 
halftoning described above. During execution, the program 416 can be stored in 
"articles" such as the memory 414. During distribution, the program 416 can be 
stored in articles such as external storage devices, removable media (e.g., optical 
discs), etc. 

[0038] The machine 410 can be an electro-photographic device, such as a 
laserjet printer or all-in-one machine. The processor 412 may be part of the 
machine's controller. In the alternative, the machine 410 could be a personal 
computer, which generates a halftone image and then stores, or transmits the 
halftone image to a printer for display. 

[0039] In color laserjet printers, for example, the illusion of continuous 
shades of color is produced by superimposing the halftones of the individual 
colorants used, e.g., cyan, magenta, yellow and black (CYMK). Since pixels are 
clustered, they are reliably reproduced by the laser printer. 
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[0040] Although several specific embodiments of the present invention 
have been described and illustrated, the present invention is not limited to the 
specific forms or arrangements of parts so described and illustrated. Instead, the 
present invention is construed according to the following claims. 
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